Impact of Implementation Facilitation on the REACH VET Clinical Program for Veterans at Risk for Suicide.

OBJECTIVE: In 2017, the Veterans Health Administration (VHA) implemented a national suicide prevention program, called Recovery Engagement and Coordination for Health-Veterans Enhanced Treatment (REACH VET), that uses a predictive algorithm to identify, attempt to reach, assess, and care for patients at the highest risk for suicide. The authors aimed to evaluate whether facilitation enhanced implementation of REACH VET at VHA facilities not meeting target completion rates. METHODS: In this hybrid effectiveness-implementation type 2 program evaluation, a quasi-experimental pre-post design was used to assess changes in implementation outcome measures evaluated 6 months before and 6 months after onset of facilitation of REACH VET implementation at 23 VHA facilities. Measures included percentages of patients with documented coordinator and provider acknowledgment of receipt, care evaluation, and outreach attempt. Generalized estimating equations were used to compare differences in REACH VET outcome measures before and after facilitation. Qualitative interviews were conducted with personnel and were explored via template analysis. RESULTS: Time had a significant effect in all outcomes models (p<0.001). An effect of facilitation was significant only for the outcome of attempted outreach. Patients identified by REACH VET had significantly higher odds of having a documented outreach attempt after facilitation of REACH VET implementation, compared with before facilitation. Site personnel felt supported and reported that the external facilitators were helpful and responsive. CONCLUSIONS: Facilitation of REACH VET implementation was associated with an improvement in outreach attempts to veterans identified as being at increased risk for suicide. Outreach is critical for engaging veterans in care.

Enhancing Implementation of Measurement-Based Mental Health Care in Primary Care: A Mixed-Methods Study.

OBJECTIVE: The complex practice of measurement-based care (MBC) for mental health conditions has proven challenging to implement. This study aimed to evaluate an intensive strategy to implement MBC in U.S. Department of Veterans Affairs (VA) Primary Care Mental Health Integration clinics. METHODS: Ten paired sites were randomly assigned to receive national MBC resources alone or with an intensive implementation strategy (external facilitation plus quality improvement teams) between May 2018 and June 2020. The intervention occurred over 12-18 months; two site pairs completed participation before the COVID-19 pandemic. Using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, the authors conducted qualitative interviews and used administrative data to evaluate the implementation, adoption, reach, and effectiveness of MBC. RESULTS: All sites improved during the study, suggesting the effectiveness of the VA's national MBC initiative. Sites with facilitation improved more than comparison sites in implementation, adoption, and reach of MBC. The effectiveness of MBC (i.e., clinician responsiveness to high patient-reported outcome measure [PROM] scores) was demonstrated at all sites both before and after facilitation. After the COVID-19 pandemic began, facilitation sites maintained or improved on their implementation gains, whereas comparison sites uniformly reported decreased emphasis on MBC. CONCLUSIONS: Implementation facilitation resulted in greater gains in outcomes of interest and helped sites retain focus on MBC implementation. Regardless of study condition, clinicians were responsive to elevated PROM scores, but MBC had a larger impact on care at facilitation sites because of increased uptake. Multiple technological and contextual challenges remain, but MBC holds promise for improving routine mental health care.

Development and Preliminary Evaluation of an Implementation Facilitation Training Program.

Background: Implementation scientists are identifying evidence-based implementation strategies that support the uptake of evidence-based practices and other clinical innovations. However, there is limited information regarding the development of training methods to educate implementation practitioners on the use of implementation strategies and help them sustain these competencies. Methods: To address this need, we developed, implemented, and evaluated a training program for one strategy, implementation facilitation (IF), that was designed to maximize applicability in diverse clinical settings. Trainees included implementation practitioners, clinical managers, and researchers. From May 2017 to July 2019, we sent trainees an electronic survey via email and asked them to complete the survey at three-time points: approximately 2 weeks before and 2 weeks and 6 months after each training. Participants ranked their knowledge of and confidence in applying IF skills using a 4-point Likert scale. We compared scores at baseline to post-training and at 6 months, as well as post-training to 6 months post-training (nonparametric Wilcoxon signed-rank tests). Results: Of the 102 participants (76 in-person, 26 virtual), there was an increase in perceived knowledge and confidence in applying IF skills across all learning objectives from pre- to post-training (95% response rate) and pre- to 6-month (35% response rate) follow-up. There was no significant difference in results between virtual and in-person trainees. When comparing post-training to 6 months (30% response rate), perceptions of knowledge increase remained unchanged, although participants reported reduced perceived confidence in applying IF skills for half of the learning objectives at 6 months. Conclusions: Findings indicated that we have developed a promising IF training program. Lack of differences in results between virtual and in-person participants indicated the training can be provided to a remote site without loss of knowledge/skills transfer but ongoing support may be needed to help sustain perceived confidence in applying these skills. Plain Language Summary: While implementation scientists are documenting an increasing number of implementation strategies that support the uptake of evidence-based practices and other clinical innovations, little is known about how to transfer this knowledge to those who conduct implementation efforts in the frontline clinical practice settings. We developed, implemented, and conducted a preliminary evaluation of a training program for one strategy, implementation facilitation (IF). The training program targets facilitation practitioners, clinical managers, and researchers. This paper describes the development of the training program, the program components, and the results from an evaluation of IF knowledge and skills reported by a subset of people who participated in the training. Findings from the evaluation indicate that this training program significantly increased trainees' perceived knowledge of and confidence in applying IF skills. Further research is needed to examine whether ongoing mentoring helps trainees retain confidence in applying some IF skills over the longer term.

Provider perspectives on delivering dialectical behavior therapy via telehealth during COVID-19 in the Department of Veterans Affairs.

Dialectical Behavior Therapy (DBT) is an evidence-based psychotherapy (EBP) for repeated suicidal and nonsuicidal self-injury and Borderline Personality Disorder. There has been little research on the effectiveness or implementation of DBT via telehealth. However, literature has demonstrated that other EBPs delivered via telehealth are just as effective as in person. DBT differs from these EBPs in complexity, inclusion of group sessions, length of treatment, and focus on individuals at high risk for suicide. The coronavirus disease 2019 (COVID-19) pandemic caused mental health care services across the country and Department of Veterans Affairs (VA) to transition to telehealth to reduce infection risk for patients and providers. This transition offered an opportunity to learn about implementing DBT via telehealth on a national scale. We conducted a survey of DBT team points of contact in VA (N = 32) to gather information about how DBT via telehealth was being implemented, challenges and solutions, and provider perceptions. The majority reported that their site continued offering the modes of DBT via telehealth that they had offered in person. The predominant types of challenges in transitioning to telehealth were related to technology on the provider and patient side. Despite challenges, most providers reported their experience was better than expected and had positive perceptions of patient acceptability. Skills group was the more difficult mode to provide via telehealth. Providers endorsed needing additional tools (e.g., means to get diary card data electronically). Multiple benefits of DBT via telehealth were identified, such as addressing barriers to care including distance, transportation issues, and caregiving and work responsibilities. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Adapting Caring Contacts for Veterans in a Department of Veterans Affairs Emergency Department: Results From a Type 2 Hybrid Effectiveness-Implementation Pilot Study.

Transitions in care, such as discharge from an emergency department (ED), are periods of increased risk for suicide and effective interventions that target these periods are needed. Caring Contacts is an evidence-based suicide prevention intervention that targets transitions, yet it has not been widely implemented. This pilot study adapted Caring Contacts for a Department of Veterans Affairs (VA) ED setting and population, created an implementation toolkit, and piloted implementation and evaluation of effectiveness. To inform adaptation, qualitative interviews were conducted with stakeholders. Data were used by an advisory board comprised of stakeholders, experts, and veterans to make adaptations and develop an implementation planning guide to delineate steps needed to implement. Key decisions about how to adapt Caring Contacts included recipients, author, content, and the schedule for sending. Pilot implementation occurred at one VA ED. Caring Contacts involved sending patients at risk of suicide brief, non-demanding expressions of care. Program evaluation of the pilot used a type 2 hybrid effectiveness-implementation design to both pilot an implementation strategy and evaluate effectiveness of Caring Contacts. Evaluation included qualitative interviews with veteran patients during implementation. VA electronic health records were used to evaluate VA service utilization in the 6-month periods immediately before and after veterans were delivered their first Caring Contact. Hundred and seventy-five veterans were mailed Caring Contacts and the facility continued adoption after the pilot. Participants were positive about the intervention and reported feeling cared about and connected to VA as a result of receiving Caring Contacts. This project developed an implementation planning process that successfully implemented Caring Contacts at one site. This can be used to further implement Caring Contacts at additional VA or community EDs.

Time and Organizational Cost for Facilitating Implementation of Primary Care Mental Health Integration.

BACKGROUND: Integrating mental health services into primary care settings is complex and challenging. Although facilitation strategies have successfully supported implementation of primary care mental health integration and other complex innovations, we know little about the time required or its cost. OBJECTIVE: To examine the time and organizational cost of facilitating implementation of primary care mental health integration. DESIGN: Descriptive analysis. PARTICIPANTS: One expert external facilitator and two internal regional facilitators who helped healthcare system stakeholders, e.g., leaders, managers, clinicians, and non-clinical staff, implement primary care mental health integration at eight clinics. INTERVENTION: Implementation facilitation tailored to the needs and resources of the setting and its stakeholders. MAIN MEASURES: We documented facilitators' and stakeholders' time and types of activities using a structured spreadsheet collected from facilitators on a weekly basis. We obtained travel costs and salary information. We conducted descriptive analysis of time data and estimated organizational cost. KEY RESULTS: The external facilitator devoted 263 h (0.09 FTE), including travel, across all 8 clinics over 28 months. Internal facilitator time varied across networks (1792 h versus 1169 h), as well as clinics. Stakeholder participation time was similar across networks (1280.6 versus 1363.4 person hours) but the number of stakeholders varied (133 versus 199 stakeholders). The organizational cost of providing implementation facilitation also varied across networks ($263,490 versus $258,127). Stakeholder participation accounted for 35% of the cost of facilitation activities in one network and 47% of the cost in the other. CONCLUSIONS: Although facilitation can improve implementation of primary care mental health integration, it requires substantial organizational investments that may vary by site and implementation effort. Furthermore, the cost of using an external expert to transfer facilitation skills and build capacity for implementation efforts appears to be minimal.

Adapting and implementing Caring Contacts in a Department of Veterans Affairs emergency department: a pilot study protocol.

BACKGROUND: Suicide among veterans is a problem nationally, and suicide prevention remains a high priority for the Department of Veterans Affairs (VA). Focusing suicide prevention initiatives in the emergency department setting provides reach to veterans who may not be seen in mental health and targets a critical risk period, transitions in care following discharge. Caring Contacts is a simple and efficacious suicide prevention approach that could be used to target this risk period. The purpose of this study is to (1) adapt Caring Contacts for use in a VA emergency department, (2) conduct a pilot program at a single VA emergency department, and (3) create an implementation toolkit to facilitate spread of Caring Contacts to other VA facilities. METHODS: This project includes planning activities and a pilot at a VA emergency department. Planning activities will include determining available data sources, determining logistics for identifying and sending Caring Contacts, and creating an implementation toolkit. We will conduct qualitative interviews with emergency department staff and other key stakeholders to gather data on what is needed to adapt and implement Caring Contacts in a VA emergency department setting and possible barriers to and facilitators of implementation. An advisory board of key stakeholders in the facility will be created. Qualitative findings from interviews will be presented to the advisory board for discussion, and the board will use these data to inform decision making regarding implementation of the pilot. Once the pilot is underway, the advisory board will convene again to discuss ongoing progress and determine if any changes are needed to the implementation of the Caring Contacts intervention. DISCUSSION: Findings from the current project will inform future scale-up and spread of this innovation to other VA medical center emergency departments across the network and other networks. The current pilot will adapt Caring Contacts, create an implementation toolkit and implementation guide, evaluate the feasibility of gathering outcome measures, and provide information about what is needed to implement this evidence-based suicide prevention intervention in a VA emergency department.

Heart Rate Variability and Cognitive Bias Feedback Interventions to Prevent Post-deployment PTSD: Results from a Randomized Controlled Trial.

Introduction: There is a long history of pre-deployment PTSD prevention efforts in the military and effective pre-deployment strategies to prevent post-deployment PTSD are still needed. Materials and Methods: This randomized controlled trial included three arms: heart rate variability biofeedback (HRVB), cognitive bias modification for interpretation (CBM-I), and control. The hypothesis was that pre-deployment resilience training would result in lower post-deployment PTSD symptoms compared with control. Army National Guard soldiers (n = 342) were enrolled in the Warriors Achieving Resilience (WAR) study and analyzed. The outcome was PTSD symptom severity using the PTSD Checklist - Military version (PCL) measured at pre-deployment, 3- and 12-month post-deployment. Due to the repeated measures for each participant and cluster randomization at the company level, generalized linear mixed models were used for the analysis. This study was approved by the Army Human Research Protection Office, Central Arkansas Veterans Healthcare System Institutional Review Board (IRB), and Southeast Louisiana Veterans Health Care System IRB. Results: Overall, there was no significant intervention effect. However, there were significant intervention effects for subgroups of soldiers. For example, at 3-months post-deployment, the HRVB arm had significantly lower PCL scores than the control arm for soldiers with no previous combat zone exposure who were age 30 and older and for soldiers with previous combat zone exposure who were 45 and older (unadjusted effect size -0.97 and -1.03, respectively). A significant difference between the CBM-I and control arms was found for soldiers without previous combat zone exposure between ages 23 and 42 (unadjusted effect size -0.41). Similarly, at 12-months post-deployment, the HRVB arm had significantly lower PCL scores in older soldiers. Conclusion: Pre-deployment resilience training was acceptable and feasible and resulted in lower post-deployment PTSD symptom scores in subgroups of older soldiers compared with controls. Strengths of the study included cluster randomization at the company level, use of iPod device to deliver the resilience intervention throughout the deployment cycle, and minimal disruption of pre-deployment training by using self-paced resilience training. Weaknesses included self-report app use, study personnel not able to contact soldiers during deployment, and in general a low level of PTSD symptom severity throughout the study. In future studies, it would important for the study team and/or military personnel implementing the resilience training to be in frequent contact with participants to ensure proper use of the resilience training apps.

Heart rate variability: Pre-deployment predictor of post-deployment PTSD symptoms.

Heart rate variability is a physiological measure associated with autonomic nervous system activity. This study hypothesized that lower pre-deployment HRV would be associated with higher post-deployment post-traumatic stress disorder (PTSD) symptoms. Three-hundred-forty-three Army National Guard soldiers enrolled in the Warriors Achieving Resilience (WAR) study were analyzed. The primary outcome was PTSD symptom severity using the PTSD Checklist - Military version (PCL) measured at baseline, 3- and 12-month post-deployment. Heart rate variability predictor variables included: high frequency power (HF) and standard deviation of the normal cardiac inter-beat interval (SDNN). Generalized linear mixed models revealed that the pre-deployment PCL*ln(HF) interaction term was significant (p<0.0001). Pre-deployment SDNN was not a significant predictor of post-deployment PCL. Covariates included age, pre-deployment PCL, race/ethnicity, marital status, tobacco use, childhood abuse, pre-deployment traumatic brain injury, and previous combat zone deployment. Pre-deployment heart rate variability predicts post-deployment PTSD symptoms in the context of higher pre-deployment PCL scores.

Outcomes of a partnered facilitation strategy to implement primary care-mental health.

BACKGROUND: Implementing new programs and practices is challenging, even when they are mandated. Implementation Facilitation (IF) strategies that focus on partnering with sites show promise for addressing these challenges. OBJECTIVE: Our aim was to evaluate the effectiveness of an external/internal IF strategy within the context of a Department of Veterans Affairs (VA) mandate of Primary Care-Mental Health Integration (PC-MHI). DESIGN: This was a quasi-experimental, Hybrid Type III study. Generalized estimating equations assessed differences across sites. PARTICIPANTS: Patients and providers at seven VA primary care clinics receiving the IF intervention and national support and seven matched comparison clinics receiving national support only participated in the study. INTERVENTION: We used a highly partnered IF strategy incorporating evidence-based implementation interventions. MAIN MEASURES: We evaluated the IF strategy using VA administrative data and RE-AIM framework measures for two 6-month periods. KEY RESULTS: Evaluation of RE-AIM measures from the first 6-month period indicated that PC patients at IF clinics had nine times the odds (OR=8.93, p<0.001) of also being seen in PC-MHI (Reach) compared to patients at non-IF clinics. PC providers at IF clinics had seven times the odds (OR=7.12, p=0.029) of referring patients to PC-MHI (Adoption) than providers at non-IF clinics, and a greater proportion of providers' patients at IF clinics were referred to PC-MHI (Adoption) compared to non-IF clinics (ß=0.027, p<0.001). Compared to PC patients at non-IF sites, patients at IF clinics did not have lower odds (OR=1.34, p=0.232) of being referred for first-time mental health specialty clinic visits (Effectiveness), or higher odds (OR=1.90, p=0.350) of receiving same-day access (Implementation). Assessment of program sustainability (Maintenance) was conducted by repeating this analysis for a second 6-month time period. Maintenance analyses results were similar to the earlier period. CONCLUSION: The addition of a highly partnered IF strategy to national level support resulted in greater Reach and Adoption of the mandated PC-MHI initiative, thereby increasing patient access to VA mental health care.

Analytical methods to detect within-individual changes in discounting.

Discounting, as a quantifiable measure of impulsivity, is often estimated within individuals via nonlinear regression. Here, we describe how to directly estimate within-individual change of the discounting parameter between 2 conditions and subsequently statistically test for that change using the discounting data from a single individual. To date, there has been no systematic description of how to conduct such an analysis. Employing the method allows investigators and clinicians to evaluate whether a single individual has statistically changed the way he or she discounts between 2 conditions (e.g., in the absence or presence of a pharmacologic, different time points, different rewards, etc.). We further describe a meta-analytic approach for combining estimated changes in discounting from individuals in a sample to make population inference. By providing more precise population estimates, this approach increases statistical power over traditional analytic methods.

Congruence of BOLD response across intertemporal choice conditions: fictive and real money gains and losses.

Intertemporal choice is predicated on the valuation of commodities with respect to delay until their receipt. Subjective value of a future outcome decreases, or is discounted, as a function of that delay (Bickel and Johnson, 2003). Although behavioral studies suggest no difference between the devaluation of real and fictive outcomes, no neuroimaging studies have investigated potential differences in the underlying deliberative process. Here, we compare behavioral and neural correlates of intertemporal valuation of real and hypothetical monetary gains as well as hypothetical losses, which have been posited to involve different mechanisms. Behavioral and neuroimaging sessions were conducted in which participants made intertemporal choice decisions in a gains condition using both real and hypothetical $100 money and in a loss condition using a fictive $100 money. Within-subject comparison of behavioral data revealed no significant difference between levels of discounting across the three conditions. Random-effects analysis of functional magnetic resonance imaging (fMRI) data of each of the three discounting conditions independently revealed significant signal change in limbic (anterior cingulate, striatum, posterior cingulate) and executive functioning areas (lateral prefrontal cortex), whereas a repeated-measures ANOVA failed to detect differences in signal change across the three discounting conditions after correcting for multiple comparisons. These data support a concordance between real and hypothetical conditions from delay-discounting studies and further suggest a congruence of the fMRI blood oxygen level-dependent signal across brain regions associated with the deliberative process of different forms of intertemporal choice.

The Semantic Object Retrieval Test (SORT) in amnestic mild cognitive impairment.

BACKGROUND: Between 10% and 15% of patients with the amnestic variety of Mild Cognitive Impairment (MCI) convert to Alzheimer disease (AD) per year. OBJECTIVE: Characterize cognitive markers that may herald conversion from MCI to AD and directly assess semantic memory in patients meeting criteria for amnestic MCI. DESIGN: Thirty-five amnestic MCI patients and 121 healthy aging controls enrolled at an Alzheimer Disease Center received a battery of standard neuropsychologic tests, and the Semantic Object Retrieval Test (SORT), a test that we have developed for the assessment of semantic memory and subsequent name production, and that has been shown to be able to differentiate between normals and patients with AD. RESULTS: On the basis of normative data from the SORT, the MCI subjects could be divided into 2 groups: 10 patients (29%) with a significant semantic impairment (SI+) and 25 without a semantic memory deficit (SI-). There was a significant correlation between all SORT variables and performance on the Boston Naming Test. In this MCI population, significantly impaired SORT performance was associated with a relative decrease in performance on tests of frontal lobe functions, although disruption of thalamic-related processes cannot be excluded as an etiology for semantic memory impairment. CONCLUSIONS: The SORT is a specific test of semantic memory, and is a sensitive measure of semantic memory deficits in patients who otherwise meet criteria for amnestic MCI. Using this specific assessment tool, a significant number of MCI patients were found to have semantic memory deficits. As these patients may be early in the course of possible progression toward dementia, the SORT or other tests of semantic memory may provide important diagnostic or prognostic information in patients with MCI.

Behavioral and neuroeconomics of drug addiction: competing neural systems and temporal discounting processes.

We review behavioral- and neuroeconomic research that identifies temporal discounting as an important component in the development and maintenance of drug addiction. First, we review behavioral economic research that explains and documents the contribution of temporal discounting to addiction. This is followed with recent insights from neuroeconomics that may provide an explanation of why drug-dependent individuals discount the future. Specifically, neuroeconomics has identified two competing neural systems that are related to temporal discounting using brain-imaging techniques that examine the relative activation of different brain regions for temporal discounting. According to the competing neural systems account, choices for delayed outcomes are related to the prefrontal cortex (i.e., the "executive system") and choices for immediate outcomes are related to the limbic brain regions (i.e., the "impulsive system"). Temporal discounting provides a useful framework for future imaging research, and suggests a novel approach to designing effective drug dependence prevention and treatment programs.

The Semantic Object Retrieval Test (SORT) in normal aging and Alzheimer disease.

OBJECTIVE: To characterize performance on a test of semantic object retrieval (Semantic Object Retrieval Test-SORT) in healthy, elderly subjects and patients with Alzheimer disease (AD). BACKGROUND: Although the initial presentation of patients with AD often reflects impairment in delayed recall for verbally encoded memory, common complaints of patients with early AD are actually related to semantic memory impairment. DESIGN: Thirty-eight AD patients and 121 healthy aging controls enrolled in an Alzheimer's Disease Center received a battery of standard neuropsychologic tests including the SORT. RESULTS: Compared with normal controls, AD patients had SORT memory impairments with significantly more false positive memory errors, fewer correctly produced names, and more substitutions in the name production aspect of the test. SORT had robust test-retest reliability in normals. CONCLUSIONS: The SORT task provides a direct, specific assessment of semantic memory, and has now been administered to 121 healthy, aging controls for normative ranges of performance, and to AD patients. The task detected semantic memory deficits in approximately half of patients with mild-moderate AD, which is comparable to other studies assessing semantic deficits in AD with less specific measures.

Neuroanatomic organization of sound memory in humans.

The neural interface between sensory perception and memory is a central issue in neuroscience, particularly initial memory organization following perceptual analyses. We used functional magnetic resonance imaging to identify anatomic regions extracting initial auditory semantic memory information related to environmental sounds. Two distinct anatomic foci were detected in the right superior temporal gyrus when subjects identified sounds representing either animals or threatening items. Threatening animal stimuli elicited signal changes in both foci, suggesting a distributed neural representation. Our results demonstrate both category- and feature-specific responses to nonverbal sounds in early stages of extracting semantic memory information from these sounds. This organization allows for these category-feature detection nodes to extract early, semantic memory information for efficient processing of transient sound stimuli. Neural regions selective for threatening sounds are similar to those of nonhuman primates, demonstrating semantic memory organization for basic biological/survival primitives are present across species.

Neural hybrid model of semantic object memory: implications from event-related timing using fMRI.

Previous studies by our group have demonstrated fMRI signal changes and synchronized gamma rhythm EEG oscillations between thalamus and cortical regions as subjects recall objects from visually presented features. Here, we extend this work by estimating the time course of fMRI signal changes in the cortical and subcortical regions found to exhibit evidence for task-related activation. Our results indicate that there are separate loci of signal changes in the thalamus (dorsomedial and pulvinar) that exhibit notable differences in times of onset, peak and return to baseline of signal changes. The signal changes in the pulvinar demonstrate the slowest transients of all the cortical and subcortical regions we examined. Evaluation of cortical regions demonstrated salient differences as well, with the signal changes in Brodmann area 6 (BA6) rising, peaking, and returning to baseline earlier than those detected in other regions. We conclude that BA6 mediates early designation or refinement of search criteria, and that the pulvinar may be involved in the binding of feature stimuli for an integrated object memory.